Papers with extensible design
NLP Workbench: Efficient and Extensible Integration of State-of-the-art Text Mining Tools (2023.eacl-demo)
Copied to clipboard
| Challenge: | NLP Workbench is a web-based text mining platform that allows non-expert users to obtain semantic understanding of large-scale corpora using state-of-the-art text mining models. |
| Approach: | They propose to use a microservice architecture to replace existing models or integrate a new one. |
| Outcome: | The proposed model is extensible and can be easily replaced or integrated with existing models. |
ActiveAnno: General-Purpose Document-Level Annotation Tool with Active Learning Integration (2021.naacl-demos)
Copied to clipboard
| Challenge: | Existing tools for document-level annotation lack document-based quality and flexibility. |
| Approach: | a new annotation tool is being developed for industry and research use cases . a configurable user interface and a RESTful API are included . authors propose to use ACTIVEANNO as default for document-level annotation . |
| Outcome: | ACTIVEANNO is an annotation tool for industry and research use cases. |
IPR: Intelligent Prompt Routing with User-Controlled Quality-Cost Trade-offs (2025.emnlp-industry)
Copied to clipboard
Aosong Feng, Balasubramaniam Srinivasan, Yun Zhou, Zhichao Xu, Kang Zhou, Sheng Guan, Yueyan Chen, Xian Wu, Ninad Kulkarni, Yi Zhang, Zhengyuan Shen, Dmitriy Bespalov, Soumya Smruti Mishra, Yifei Teng, Darren Yow-Bang Wang, Haibo Ding, Lin Lee Cheong
| Challenge: | Existing systems require users to manually select models or employ rigid routing rules that fail to capture the continuous spectrum of query complexity. |
| Approach: | They propose a quality-constrained intelligent prompt routing framework that automatically selects optimal models based on predicted response quality and user-specified tolerance levels. |
| Outcome: | The proposed framework achieves 43.9% cost reduction while maintaining quality parity with strongest model in the Claude family and processes requests with sub-150ms latency. |
Beneath the Facade: Probing Safety Vulnerabilities in LLMs via Auto-Generated Jailbreak Prompts (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a gap exists in systematic assessment of real-world safety risks . a lack of evaluation frameworks to keep pace with the breadth and variability of real risk factors. |
| Approach: | They propose a framework that assesses security vulnerabilities by deriving scenario-driven jailbreak prompts using an adversarial agent. |
| Outcome: | The proposed framework detects vulnerabilities in scenario-driven jailbreak prompt generation . it supports plug-and-play jailbreak strategies and adapts seamlessly to multimodal settings. |